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Where We Began: 

The Cloud/Climate Feedback Problem 


Key Measurements Addressing 
the Cloud-Climate Feedback Problem 


Microphysical parameters: 

1. p = d(lnm)/dT dependence of cloud water (liquid and ice) content on 

temperature (including liquid to solid transition 
temperature and small ice particle concentrations) 


2. y = d(ln x) / dT dependence of cloud opacity on temperature 

(implicitly, dr / dm; dr / dT ) 


Cloud properties: 

3. n(q, w, T) dependence of cloud amount on relative humidity, vertical 

velocity, temp., and other environmental parameters 

4. cloud top height dependence on temperature, relative humidity, vertical 
velocity, and and other environmental parameters 

5. variability in cloud behavior (diurnal, seasonal, interannual; land & ocean) 

Cloud-related processes: 

6. distinguish T from dynamical effects on clouds (sign & size of feedbacks) 

7. determine large-scale conditions for formation and breakup of marine 
stratocumulus (Cloud Top Entrainment Instability) 

/ * «S 

8. determine the relationship between deep convection and upper troposphere 
water 


SENSITIVITY OF DERIVED EFFECTIVE CLOUD 
AMOUNT TO SURFACE TEMPERATURE 
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On the right side, the terms in the denominator account for 

(1) direct radiation from the surface 

(2) solar radiation reflected by the surface 

(3) emission of the atmosphere below the cloud level 

(4) emission from the cloud surface. 


The terms are wavelength dependent 


Hie derived cloud amount is less sensitive to surface temperature for 
higher clouds. This occurs because as the cloud elevation increases, the 
difference between Ts and Tc increases, so only a small change in cloud 
amount is needed to effect a large change in radiance at the detector. 


Pressure 








Definition of Validation 


By ’Validation 1 , we mean ’developing a quantitative 
sense for the physical meaning of the measured 
parameters’, by: 


(1) identifying the assumptions involved in deriving 
parameters from the measured radiances 


(2) testing the input data and derived parameters for 
statistical error, sensitivity, and internal consistency 


(3) comparing with similar parameters obtained from 
other sources using other techniques 


Identifying the Assumptions 


in the Measurements (instrument, technique) 
in the Algorithm (retrieval equations) 
in the Code (’if statements) 


GSFC HIRS2 Level 2 to 3 Software Overview / Assumptions 


MAIN44 

- initialize variables 
• call subroutines 
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SET UP VARIABLES > 
■ select HIRS2 parameters and time intervals 
for processing (PROCESS_PARMS) 
set up variables (RDTOPO, INIT) 



, HERS2/MSU 
[LEVEL 2 DAILY 
PARAMETERS 


READ INPUT DATA 
read daily retrieval data from input 
tape (RDAILY; PARSEJDATA) 

/ 


CALCULATE AVERAGES 
^for each parameter in each bin, and note) 
bins w/missing data (TIMAVG) 



only allow: 

> Lai <= 90 
Lon <= 180, 


Define day (not night) as 
8-5 to 20.5 local hours 


^ Only include data from 
'good' temp, retrievals: 
EERR >= 0 
in averages of all parameters I 
V EXCEPT CLOUDS ) 

K)nly allow surf, temp.?) 
\^200 < STEMP < 350 h 


j Reject data if temp, came 
climatology (if IERR a 



SET DAY / NIGHT FLAG'' 
(DAYNITE) 


EMIS TEMP 
Land: >0.9 — 

<0.9 <275 
<0.9 >275 
Ocean: — >275 

>0.7 <275 
0.65 to 0.7 <275 
<0.65 <275 


CLASS 
Dry Land 
Snow 
Moist Soil 
Ocean 
Ice 

Ice /Water 
Ocean 


Ocean: TOPOG in bin <= 0 


SUM ALL THE DATA 
* for the time period requested 
- for each geographic bin 
■ for each parameter requested; 
and accumulate the # of entries 
(SUMDATA) 


Reject data if retrieved SST 
differs from climatology by 
7 K or more 


If the retrieved SST is 
between between 5 and 7 K 
greater (less) than 
climatology, set SST to 
^climatology + 5 K (- 5 K) J 



Accumulate Day and Night 
Surface Temperatures 
(SUMTMP) 



\ 

_L 


If temp is > 275, 
emissivicy < 0.9, and an/ j 
surrounding bin is ocean, j 
classify as Dry Land 
rather than Moist Soil 




f Only allow ozone values 
100 < OZONRT < 600 
dobsons 


Accumulate Day, Night, and 
Day + Night Ozone 
(SUMOZO) 

T 

( Accept ozone value only if > 
measurement sensitivity is high 
(1 deg change in H9 brigthness 
(03SENS) changes ozone by 
less than 50 dobsons). . 





[Limits on min and max layer 
l thickness not implemented y 


/Only allow emissivity values: ] 
l 0<SEMIS<1 J 


Reject data if water retrieval 
flag is bad (IWATERcO) 


Reject data if obs and computed^ 
Tb in Channel 8 differ by more 
l than 3 K (ABS (DEF8) >3) j 


Accumulate Layer 
Thicknesses for up to 12 
layers (SUMTHK) 



Accumulate Surface 
Emissivity from 
MSU channel 1 
(SUMEMI) 


Accumulate Column PpC\ 
Water, Upper Level Ppu 
Water, and Surf. Pressure for, 
> — Ratio (SUMPRCY^^ 



Reject data if obs and computed 
Tb in Channel 10 differ by more 
than 3 K (ABS (DBF10)>3) 


Limits on min and max 
temperatures at each level 
^ not implemented 

^AII Cloud Fractions are thT' 
sum of Cld. Frs. reported 
^ for elds. in 2 layers 

^Only allow cld. fract. values' 
in layer 1: 

i 0 <= CLFR4 <= 1 


\ Reject data if the brighmess 
temp, fit for 5 cld. retrieval 
channels (FIT) > 5 K, when 
layers 1 and 2 are included 



Accumulate Temperature 
Profile Data at up to 20 
s. Levels (SUMTRT) ^ 


'^Accumulate Day + Night, DayN, 
and Night Total Cld. Fractions 
and Cloud Top Pressures, and 
High, Middle, and Low Cld. Frs., 
v and albedo, in 4 quadrants S 


(SUMCLD) 


If albedo > 1, it is set to 1 
(RATIO =100.) j 


Reject dam if the need for cld.' 
is small (RMSNO < 5), and 
2-layer cld. correction doesn't 
help much (FIT > 2) 


Skip albedo calculation if it 
is night (ANGSUN > 75) 


Set cld. = 0 if the need for cld. 
is small (RMSNO < 2), and 
1-laycr cld. correction doesn't 
help much (FITCK> 0.7) 


Set cld. = 0 if (1) cld within 150 
mb of surface, (2) fit is good w/o 
cld (RMSNO < 3). (3) cld fract > 
0.4, and (4) window channel fits 
well (BTD < 2) 


Set layer 2 cld = 0 if (1) layer 2 
cld is within 100 mb of surf and 
layer 2 cld doesn' t help the fit 
(F1TCK > 0.9), or (2) layer 2 cld 
fract >0.4 and FITCK> 0.95 


Level lb Radiances: 
4x4 HIRS2 spots + one 
overlapping MSU sounding 


HIRS2/MSU PHYSICAL RETRIEVAL: 

OVERVIEW of CLOUD PARAMETER DERIVATION 

•ftg; | _ " last revised: 


( At least one ' 
octant must not 
be completely ““*< 
cloud covered^ 

' 

Assume the octant 
with the wannest 
11 pm brightness 
temp, is clearest, j 


% some soundings 1 
have land & others 
ocean dags in a 4 x 
4 group, do one 
retrieval each over 
l land and water. J 


CALCULATE 

^(the cloud correction factor^ 
Sir from two octants) 
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■rlND ’CLEAREST OCTANTS 
Select the octant pair with the 
warmest window channel 
radiance (H8) for clear column 
temperature analysis. 
X^ ^jsELQUD) X 

/ 


yr USE MICROWAVE TO CORRECT X 
f ' IR RADIANCES FOR CLOUD X 
• estimate the expected clear column radiances in IR’ 
channels H13 and H14 and pwave channel M2 using 
^radiative transfer model initialized with first guess J 
N. - use (observed - model) M2 to correct 
H13 and H14 for cloud 


Assume effective cloud amount, 
but not other cloud properties 
(particle properties, cloud 
pressure level), varies over 
two octants (about 60 lon2). 


2. 1 Ignore cloud edge effects. 


, H 

(A 


First Guess Temp. *4 

Profile from GCM & / 

Climatology y 

(Constrains shape of the 

final profile.) / 

= =is 

r Assume M2 accurately ’ 
sounds temperature in the 
same region as H13 and 
H14, and is not affected by 
iquid water drops and other 
opa city sources. J 

* Determination of which ^ 
channels get cloud correction* j 
is done only mi the first ^ 
y iteradon of the retrievaL J \ 

f So cloud correcdon is appliedN 2. ^ , 

V to the tiwave channels, s * 

f For IR window channels > 

I (peak > 1000 mb), cld.corr. l^‘ 

V is always applied. J 

f For IR channels sounding ^ 4. ^ 

1 very high (peak < 275 mb), j 

V eld, corr. is never applied. J 

^Apply cld. core, for all channels) 
from lowest up to the first for Y 

V which (warm - cold) < 03 J * 


/V. ^ I(V)-Il(V)X 

' Solve: t) == 

Il(v)-I 2 (v) 
using corrected clear-column 
radiances and observed radiances 
X for H13 and H14. 
^^(ETACLD) 


(1) problem with H8, H13, H14 
[ (warm - cold) < - 5. ] 
or 

(2) almost full overcast 
vJ [ (warm - cold) > 8 and^ >4 


\ 

^ \ 
\ ^ 


FIND CLOUD X 
' CORRECTION LEVEL > 
above which cloud effects are 
< ignored. J 

X^fCLDCOR) 


f Assume the cloud IR \ 
^reflectivity is zsm.J 

^Neglect differences inN 
surface reflection 
between clear and 
y cloudv condidons. y 

(tj is a weighted ave. or 
^ H13 & H14 values, j 

{\f T| is cloudy (>4) and^ 
(warm - cold) is small 
ploug h (<8), s et q = 4y 

^If t) < 0, it is set to 0. ) 


g f If (warm - cold) is small’ 
^ (<= 1), and (clear • warm) 
is small (<= 3). serq = 
V - 03 and call it clear© 

y* ' \ 

r The values (warm - cold) & 

(clear - warm) used to test T) 

are obtained from either H13 

HI4, or both. If the test 

value for a channel is small 

(< 0.009), it is ignored. If 

both are small, H14 is used. 

To obtain i\ itself, both 

channels are always used / 


fact T| to 5: set IERR to 4. N 

SKIP TO SECnON C 

For Ocean cases only, use First 
Guess Temperature Profile. 
N^For Land, reject data-x^ 


( Corrected clear coL observed Y/ 

f For no correction, or if clear \ 

Use first guess 


radiance is set to j 

coL rad. <= 0, set clear col rad. j 


V [ w arm + n • (warm - cold) ] J 

\ to 03 * (warm - cold) J 

tem Dentures 

m 






Assume the cloud amount ratio' 
is independent of wavelength 
across the 4 and 14 lira bands, 
and is determined with the 
^ assumptions of A3. J 

| Neglect any cloud] \ 
effects on the I 1 

l MSU channels. A 


^calculate CLEARS 

COLUMN TEMPERATURE 
„ ^ PROFILE 


^FIND CLEAR COL.^\ 
BRIGHTNESS TEMP. 

IN 7 CHANNELS 
(H2, H4, H13, H14, HIS, M3. M4) 
for the 2 wannest octants, using for 
cloud co rrection, 


'Assume climatology 
represents all the 
information about the 
shape of the clear 
column temperature 
profile not contained 
^ in 7 channels. J 

FIRST GUESS 
• TEMPERATURE 
PROFILE 


S ' 

Assume a Lambertian surface, 
with emissivity for land areas 
of 0.85 at 4 pm, 0.98 at 15 
Jim; for ocean, it is taken as 
^0.95 at 4 inn, 0.98 at 15 nm. 


ITERATIVELY ADJUST 
THE TEMPERATURE 
PROFILE 

to fit clear column temperatures 
V from 7 channels 


Ignore any cloud effects], 
on H8, H18, H19. ) 


' For night, take ave. of 3 ' 

separate surf. temp. ?>. 

determinations. For day, solve ■** _ 
simulL for surf. temp, and 
^ reflectivity with H18 and H19^ 

f Reject any derived^ * 

temp, that deviates > 4.^, 

1-5 deg. from the s 
mean of derived 
V temps. J 

'Use weighting to compensate for the 
sire of water vapor (H8), reflected 
solar radiation (H18, H19 daytime 
obs.), cloud and other corrections 
\whcn averaging surf, temp. valoes.> 

/ v y 

Use climatology for seal 

surf. temp, if (1) the / 
spread in derived temps. / 
is too large or (2) the 6. 
final result deviates > 5 
sdeg from climatology. 


OBTAIN SURFACE 
TEMPERATURE 
. (H8, H18, H19) ^ 


Residuals large ?N 

(1) RMS error > 1 or 
(2) calc. M2 brightness temp, 
deviates from obs. by > 1 deg- 


"Only 3 or 4 iterations ' 
of the surface temp, 
section are allowed for 
each retrieval 


'RETURN TO STEP A.2.^ 

Use most recendy derived temp. 

. structure instead of GCM and . 
climatology 



Assume the 
residuals from G2 
are associated with at 
^second cloud IcveL/ 



Neglect differences in' 
surface reflection 
between clear and 
V cloudy conditions. 


Assume all cloud 
midophysical properties arej 
independent of wavelength 
between 11 and 15 microns., 


Constrain cloud pressure^ 
fall between 950 mb 
and tropopause. 

Assume all clouds are 
physically thin (radiate at a 
single temperature), with 
^well-defined cloud tops. J 

Assume effective cloud ^ 
amount and cloud pressure, 

| but not other cloud properties, 
vary over four quadrants, j 


intermediately derived 

original data products 



Figure 3. Interactive Data Extraction and Analysis System 






THE NEED FOR LEVEL 2 DATA 


3 COLOR IMAGES SHOW HIRS2 JULY 1979 CLOUDS 

(1) 2 X 2.5 DEGREE BIN, 

(2) 500 X 500 KM BIN 
AND (2) - (•!) 






















Original Level 2 
(point) daia 
Set 1 

• HD F Forma: 

Original Level 2 
(point) data 
Set 2 

HDF Format 


Exploratory Data Analysis Acitvities 


Select Parameters 
and Subsets 

temporal, error condition, 
and other sampling 
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Original Level 2 
(point) data. 
SetN 

HDF Format 


Gridding 




Level 2 (point) Data 
Display 

(sampling locat i o ns and 
statistics shown] 


Interactive Geographic 
Subset Selection 


Subset Files 



HDF Format 


Interactive 
Data Analysis 
Procedures 


Surface Fitting 


Output Files, and 
B & W and Color 
Hardcopy 


( C1 

I cor 

V ai 


cluster & 
component 
analysis 


surface 

comparison 

algorithms 


time series 
and other 
analysis tools 


Statistical Analysis Tools 


3 Srs: 

YTUALK? i fj 



IDL & NCSA 
image analysis 
tools 


MacSpin 
& other virtual 
3-D analysis 
tools 


Data Desk 
Scauerplot Matrix 
& other 

statistical-graphical 
interactive tools 










FIGURE A.6 


FILE 


Open 

Close 

Save 

Save Box 
in Old Dir 
in New Dir 
Save Data 
as Tabular 
asHDF 
as Both 
Save Region 
Print 

Postscript Plot 
Session Log 
Quit 


TOOLS 


WIGSS MENUS 


EDIT 
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Select Box 

Define New Box 
Select Previous Box 
Select Region 

Define New Region 
Select Previous Region 
Display Level 2 Data 
Zoom Box 

Create Zoom 
Hide Zoom Box 
Show Zoom Box 
Remove Points 
Clear Display 
Reset 


COLOR 


Select New Palette 
Select Default 
Color Scale 

Create Color Scale 
Hide Scale 
Show Scale 


Thermodynamics 
Dewpoint 
Equiv. Pol Temp. 

Lift Cond. Level 
H20 Mass Mix Ratio 
PotenL Temp. 

Sat Mix. Ratio 
Sat Spec. Hum. 

SaL Vapor Press. 
Specific Humidity 
Vapor Pressure 
Virtual Temperature 
List Data 
Level 3 
Level 2 
Contour Plot 
Surface Plot 
Histogram 
Variogram 
Create Postscript Plot 
with Region Outline 
without Region Outline 
Build Procedure 



DISPLAY PARAMETERS 


Session Log 
Box Info 
HDF File Desc. 
Intro Msg. 
Postscript Plot 


Parameter 1 
Data 

Standard Dev. 
Counts 
Parameter 2 
Data 

Standard Dev. 
Counts 
Parameter 3 
Data 

Standard Dev. 
Counts 


Help Menus 
Help Variables 
Help Procedures 
About WIGSS 


Parameter N 
Data 

Standard Dev. 
Counts 
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EDA HIRS2/MSU STANDARD DATA FILES PROCESSING 

— Problem of multiple machine architectures 

We converted our data files to Hierarchical Data Format (HDF). 
[Developed at NCSA (National Center for Supercomputer Applications)] 

— Problem of data documentation 

[How are the fields stored, what do they mean (units, definitions, 
assumptions)?] 

HDF solves a part of these problems (some information about ’data 
objects' is stored in HDF files) 


What We Have Learned About Standard Data Handling Time Scales: 

— To discover the need for HDF, learn HDF, and apply it - ^ 1 year 

” Knowing what we now know, to rebuild from scratch - ** 6 months 

-» To create HDF files for a different data set, of comparable complexity, 
in an arbitrary format - 

<<k 2 months, depending on the documentation and hardware availability 

~ To ingest a different data set, of comparable complexity, that is already 
in HDF format - 

~ 2 weeks to read data, test, and to study the documentation 


For data analysis, the issue of assumptions is a large one, not addressed in 
the standard data processing (discussed later). 


Partial List of Software That Automatically Reads 

Files in HDF Format 


Currently Available: 


NAME 

Platform 

Source 

Data Scope 

Mac 

NCSA 

Image Tool 

Mac 

NCSA 

Layout 

Mae 

NCSA 

Transfonn 

Mac 

Spyglass 

Format 

Mac 

Spyglass 

Dicer 

Mac 

Spyglass 

X-jmage 

Sun* 

NCSA 

XDS 

Sun 

NCSA 

Reformat 

Sun 

NCSA 

APE 2.0 

Sun 

Ohio State 


In Development or Testing: 


Comments 

Display, manipulate arrays & images 
Display, animate image & color bar 
Create presentation from images, text 
Combines Data Scope & Image Tool 
Similar to Layout 

Select & view sections of 3-D display 
Combines Data Scope & Image Tool 
Similar to Dicer 

Convert FITS, TIFF, GIF, SUN, raw 
raster files, & x-window dumps to HDF 

Object-oriented prog, language 
Interactive graphics prog, language 


IDL Sun RSI 

IGSS Sun JPL/EDA Interactive Geographic Subset Selection 

netCDF filter Sun NSF Convert netCDF to HDF 

* 'Sun' also runs on many other UNIX platforms, including Apollo, 
Alii ant, Convex, Cray, DEC-ULTRIX, and IRIS Workstations. 


HDF Software in 
an Integrated 
Computing 
Environment 













HDF Ffle with 
Scientific Dataset 




0 


90 by 100 


data: ’pressure'*, diia 1: "a v»r. dim £ "y y* r 


data: pa s c als ’*, dim 1: "ona/sec". dnnj>: "cm/sac 


aim 1: T10.0", dim 2: T8.r 



1 : loo, ioo, 300, 400, soo, «oo, 700, , . . 

sizzi 2 * 0*1. 6 . 2 . 0.3. 0.4. fl.i. n c a ^ a ■ 


rORSJUUT: 

INTEGER 

INTEGER 

REAL 

REAL 

INTEGER 

REAL 

ahapa (1) - 90 
snap* (2) - 100 


DFSDaatdlma, DFSDaatdataatra, DFSPaatdlmstra 

DFSDaatdiascala, DFSDputdata 

praaal(90,100> , praaa2 {90,100) 

d#nl (90, 100) , dan2 (90,100) 

ahapa (2), rac — 

**eala<90) , yacala<100) 


rat — DFSDaatdina (2, shapa) 

rat - DFSDaatdataatra ('praaaura 1', 'Paaeala', 'E15.9* •*> 

r * c * DFSOaatdimatra (1, *x val', 'ca/aac', TIO.O*) 

r *^ * OFSDaatdlajcra (2, 'y val', •ca/aac', 'FA,!') 

rat - DFSDaatdiascala (1, ahapa(l), xacala) 

rat - DFSDaatdiascala(2, ahapa(2), yacala) 

rat - DFSDadddata < *SOax4 .hdf * , 2, ahapa, praaal) 

rat “ DFSDaatdataatra ( 'praaaura 2*, 'Pascals', *E15 9* 
rat - DFSDadddata ( ' SDaxl . hdf • , 2, ahapa, praaa2) 

rat - DFSDclaar () 

r ? c ” DFSDaatdataatra ( 'density 1 ', ' 9 /ea 3 ', 'S15 9* • •) 
rat - DFSDadddata (*SDax4. hdf. 2. ahapa, danl) ’ ' 

rat - DFSDaatdataatra ( 'danaity 2', 'g/ca3', 'E13.9' ••) 
rat - DFSDadddata ( • SDax< . hdf * , 2, ahapa, dan2) 







HIRS2/MSU HDF LABEL 


. FILE IDENTIFIER LENGTH: 5 
FILE IDENTIFIER: LABEL 
FILE DESCRIPTOR LENGTH: 1831 
FILE DESCRIPTION: 

Description: HIRS2/MSU parameters retrieved using the 

Goddard Laboratory for Atmospheres (GLA) 

Physical Inversion Algorithm Baseline 4.0. 

They are stored as individual objects of an 
HDF file. These files are the standard data 
source for most data analysis applications. 

Most of the parameters delivered on the original 
GSFC tapes are included. The following 
parameters were eliminated ( either because 
of questions about definition, redundancy, 
or problems of interpretation of the values ) : 
tau; dlat; dlon; np; cidhgt; cldfrc; retwatCl); 
retwat(5); humret{13); rthick. Thirty_seven 
paramaters remain. They, are listed and 
defined in /edal/doc/hirs_daily/rec.doc. 

Level 2 data for: 06 jul 79, OZ - 24Z. Platform: TIROS-N 

Reference: Susskind, J., J. Rosenfield, D. Reuter and 

M. T. Chahine, 1984: Remote sensing of 
weather and climate parameters from HIRS2/MSU 
on TIROS-N. J. Geophys. Res. 89, 4677-4697. 

Contact: Robert Haskins 

— Jet Propulsion Laboratory 

Mail Stop 183 - 301 
4800 Oak Grove Dr 
Pasadena, CA 91109-8001 

(818) 354-6893 


Regional Boundaries are: Global 

Number of Parameters: 37 
Parameters : 

YTMMDD, HHMMSS, QUADLATS, QUAD LONS, DNFLAG, 
LANDWTR_FLAG, SAT_ZEN_ANGLE, G£OPOT_THICX, 

HIRS8_OBS, VIS_R£FLECTANCS, SRFC EMIS MW, SRFCJPRES 
TROP_PRSS_RTR, ~SRFC_TMP_RTR, SST~ANOMALY, 

TMP_P ROF I LE_RTR , QUAD_NUM_TMPS, QUAD_FLAG, 

tmpIrtr.flag, tb_residual7 T3_RMS_TMP, 

RHUM_PROF_ATR, ?R£CI?_WTR, WATER_FLAG, TB RMS WTR, 
HIRS 8_TBD IF_WTR, HIRSTo_T 3DIF_WTR, CLCUD_SFRAC_L1 , 
CLODD~TOP_.PRES_.Ll, CLOUD JBFRAC ' L2," ' CLOUD TOP_PR£S L2, 

rms_srr_inccld, rms_err precld, cloud clear_parm7 

HI RS 8_TBD I F_CLD , OZONE_RTR, 03SENS 
Coasnents : 

Binary HDF file creation date: Mon Nov 4 16:42:31 EST 1991 
Binary HDF file created on a CRAY Y-MP 


SDS COUNT: 37 

SDS DATA DIMENSIONS: 4 x 44821 


HIRS^/MSU HOF J-AHtO 


SDS DATA LABEL: QUADLATS 
SDS DATA UNITS: Degrees 
. SDS DATA FORMAT: F$.2 

HDF OBJECT REFERENCE NUMBER: 9 
HDF OBJECT DESCRIPTION: 

Latitudes of four individual quadrants for cloud retrieval 

Original Name » FLAT , • 

SDS DATA DIMENSIONS: 4 x 44821 
SDS DATA LABEL: QUADLONS 

SDS DATA UNITS: Degrees . ......... ....... . . . .. . , 

SDS DATA FORMAT: F7.2 

HDF OBJECT REFERENCE NUMBER: 12 

HDF OBJECT DESCRIPTION: 

Longitudes of four individual quadrants for cloud retrieval 

Original Name m FLON — - 

SDS DATA DIMENSIONS: 1 x 44821 
SDS DATA LABEL: TMP_SRR FLAG 
SDS DATA UNITS: N/A ~ 

SDS DATA FORMAT: 13 

HDF OBJECT REFERENCE NUMBER: 57 

HDF OBJECT DESCRIPTION: ■ 

Error flag for temperature retrieval. . .. 

“> Positive IERR means successful 
temp retrieval and retrieved temp 
yes used for water, ozone, and 
cloud retrieval . 

-> Negative IERR means temp 
retrieval failed and first guess 
temp and moisture is used in 
subsequent cloud retrieval . 


1000+x Converged on Xth iteration in retrieval 
This parameter is always stored as 1 on 
the tapes that we receive from GSFC. 

1100 Did not converge after 9 iterations. 

This parameter is always stored as 1 
on the tapes that we receive from GSFC 
( The information about whether or not 
the retrieval converged is lost.) 

2 SST retrieval was not attempted 
over ocean, climatology SST* is used. 

3 Residual for HIRS2 channel 2 was large. 
Ignore retrieved temperatures above 200 mb. 

-4 Cloud clearing was not attempted; 
too cloudy to do a retrieval'. 

“5 Big ( l degree ) RMS on Tb residual 
in temp sounding channels, or 
in MW2 channel . 

Not used. 


-6 


EDA HIRS2/MSU STANDARD DATA FILES PROCESSING 

Hierarchical Data Format 

We have developed software that: 

1. Automatically moves HIRS2/MSU physical retrieval data 

from the IBM tape archive to the GSFC Cray 



2. Automatically converts the data into HDF format, including 
adding file labels and detailed parameter descriptions 

3. Automatically transfers the HDF files to a user-specified 
remote node via the FTP utility 

We also have some standard utilities, and there is software in development, 

that takes HDF files and 

displays HDF label information 

creates floating point image data from HDF vector data 

displays floating point image HDF files and performs 
several kinds of analysis 


EDA HIRS2/MSU STANDARD DATA FILES PROCESSING 
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r 


IBM Tape Archive List 
- obtain desired tape name and 
number from lookup table using 
internal dock time (tau) 



last revised: 11/12/91 
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HIRS2/MSU 
I IBM Tape Archive 
(GSFQ 

- binary IBM records 


HERS2HDF 

(rons on GSFC Cray) 

- Accepts userrequest 
Obtains retrieval dam from IBM archive 
■ Creates file header and documentation 
- Converts IBM data files to HDF 
■ Transfers HDF files to remote node 


FTP over 
^TCP/IP net 


H2_PARM_SELECT 

(runs on remote UNIX node) 

- user selects desired parameters 
• error checking (currently uses the 
standard GSFC error 
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HIRS2/MSU 
HpF-SDS PARAMETER FILES 
(resides at remote node) 
-most parameters from IBM tape 
archive, translated to HDF, 
Name: mmmddyy.Ldf 
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HIRS2 / HDF 
ARCHIVE 

25 MB/day 
(medium TBD - 
CD ROM possible) 


HIRS2/MSU 

HDF SELECTED PARAMETER FILES 
• contains lat, Ion, time, and param values (with 
related flags where appropriate) 

J- working files - reside temporarily on remote node 
- user selected parameters & dates 
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HIRS2/MSU 

HDF SELECTED PARAMETER FILES 
• contains he. Ion, time, and param values (with 
related flags where appropriate) 

■ working files - reside temporarily on remote node 
• user selected parameters & dates 
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GRIDIT • 
- gridding 




FELTERIO 

^ [In Development] 

(runs on remote XJNIX node) 

• allows user to select first-order processing 
^writes out new HDF image- vector file or adc 
to an existing one 









SUMMARY 


Validation Issues 

Statistical characterization of data sets 

Finding statistics that characterize key attributes of the 
data sets 

Defining ways to characterize the comparisons among 
data sets (Scale issues, statistics,...) 


Selection of specific intercomparison exercises 


Selecting characteristic spatial and temporal regions for 
intercomparisons 

Impact of validation exercises on the logistics of current 
and planned field campaigns and model runs 


Preparation of data sets for intercomparisons 

Characterization of assumptions 
Transportable data formats 
Labeling data files 
Content of data sets 

Data storage and distribution (EOSDIS interface) 



